Learning 3D Navigation Protocols on Touch Interfaces with Cooperative Multi-Agent Reinforcement Learning

Using touch devices to navigate in virtual 3D environments such as computer assisted design (CAD) models or geographical information systems (GIS) is inherently difficult for humans, as the 3D operations have to be performed by the user on a 2D touch surface. This ill-posed problem is classically solved with a fixed and handcrafted interaction protocol, which must be learned by the user. We propose to automatically learn a new interaction protocol allowing to map a 2D user input to 3D actions in virtual environments using reinforcement learning (RL). A fundamental problem of RL methods is the vast amount of interactions often required, which are difficult to come by when humans are involved. To overcome this limitation, we make use of two collaborative agents. The first agent models the human by learning to perform the 2D finger trajectories. The second agent acts as the interaction protocol, interpreting and translating to 3D operations the 2D finger trajectories from the first agent. We restrict the learned 2D trajectories to be similar to a training set of collected human gestures by first performing state representation learning, prior to reinforcement learning. This state representation learning is addressed by projecting the gestures into a latent space learned by a variational auto encoder (VAE).Comment: 17 pages, 8 figures. Accepted at The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases 2019 (ECMLPKDD 2019

Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class Object

Structured note-taking forms such as sketchnoting, self-tracking journals, and bullet journaling go beyond immediate capture of information scraps. Instead, hand-drawn pride-in-craftmanship increases perceived value for sharing and display. But hand-crafting lists, tables, and calendars is tedious and repetitive. To support these practices digitally, Style Blink ("Style-Blocks+Ink") explores handcrafted styling as a first-class object. Style-blocks encapsulate digital ink, enabling people to craft, modify, and reuse embellishments and decorations for larger structures, and apply custom layouts. For example, we provide interaction instruments that style ink for personal expression, inking palettes that afford creative experimentation, fillable pens that can be "loaded"with commands and actions to replace menu selections, techniques to customize inked structures post-creation by modifying the underlying handcrafted style-blocks and to re-layout the overall structure to match users' preferred template. In effect, any ink stroke, notation, or sketch can be encapsulated as a style-object and re-purposed as a tool. Feedback from 13 users show the potential of style adaptation and re-use in individual sketching practices

Making history: intentional capture of future memories

Lifelogging' technology makes it possible to amass digital data about every aspect of our everyday lives. Instead of focusing on such technical possibilities, here we investigate the way people compose long-term mnemonic representations of their lives. We asked 10 families to create a time capsule, a collection of objects used to trigger remembering in the distant future. Our results show that contrary to the lifelogging view, people are less interested in exhaustively digitally recording their past than in reconstructing it from carefully selected cues that are often physical objects. Time capsules were highly expressive and personal, many objects were made explicitly for inclusion, however with little object annotation. We use these findings to propose principles for designing technology that supports the active reconstruction of our future past

Carrier velocity‐field characteristics and alloy scattering potential in Si1−xGex/Si

The alloy scattering potential is an important parameter in SiGe alloys since it not only affects the velocity‐field characteristics for carrier transport, but also allows increased optical transitions by relaxing k‐selection rules. In this letter, we report on the velocity‐field measurements for relaxed and coherently strained SiGe alloys. The alloy scattering potential is obtained from a careful fit to the data. The hole velocity at any field is found to have a bowing behavior as a function of alloy composition. This reflects a strong alloy scattering potential which is calculated to be 0.6 eV for the valence band.  Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/70374/2/APPLAB-63-10-1393-1.pd

Static Electric Fields and Lightning Over Land and Ocean in Florida Thunderstorms

Natural cloud-to-ground (CG) lightning and the charge structure of the associated clouds behave differently over land and ocean. Existing literature has raised questions over the years on the behavior of thunderstorms and lightning over oceans, and there are still open scientific questions. We expand on the observational datasets by obtaining identical electric field observations over coastal land, near-shore, and deep ocean regions during both clear air and thunderstorm periods. Oceanic observations were obtained using two 3-meter NOAA buoys that were instrumented with Campbell Scientific electric field mills to measure the static electric fields. These data were compared to selected electric field records from the existing on-shore electric field mill suite of 31 sensors at Kennedy Space Center (KSC). CG lightning occurrence times, locations and peak current values for both on-shore and ocean were provided by the U.S. National Lightning Detection Network. The buoy instruments were first evaluated on-shore at the Florida coast, to calibrate field enhancements and to confirm proper behavior of the system in elevated-field environments. The buoys were then moored 20NM and 120NM off the coast of KSC in February (20NM) and August (120NM) 2014. Statistically larger CG peak currents were reported over the deep ocean for first strokes and for subsequent strokes with new contacts points. Storm-related static fields were significantly larger at both oceanic sites, likely due to decreased screening by nearby space charge. Time-evolution of the static field during storm development and propagation indicated weak or missing lower positive charge regions in most storms that initiated over the deep ocean, supporting one mechanism for the observed high peak currents in negative first strokes over the deep ocean. This project also demonstrated the practicality of off-shore electric field measurements for safety-related decision making at KSC

Just-In-Place Information for Mobile Device Interfaces

Abstract. This paper addresses the potentials of context sensitivity for making mobile device interfaces less complex and easier to interact with. Based on a semiotic approach to information representation, it is argued that the design of mobile device interfaces can benefit from spatial and temporal indexicality, reducing information complexity and interaction space of the device while focusing on information and functionality relevant here and now. Illustrating this approach, a series of design sketches show the possible redesign of an existing web and wap-based information service.

Direct measurement of the Hall factor for holes in relaxed Si1−xGex (0<x<1)

The Hall factor for holes in relaxed p‐type Si1−xGex alloys has been determined from mobility measurements at magnetic fields up to 7 T at 290 K. Our data together with previously published values for Si and Ge suggest that r for holes in SiGe varies between 0.73 and 1.7 with a possible strong bowing.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/70214/2/APPLAB-64-23-3110-1.pd

Sketchnote Components, Design Space Dimensions, and Strategies for Effective Visual Note Taking

Sketchnoting is a form of visual note taking where people listen to, synthesize, and visualize ideas from a talk or other event using a combination of pictures, diagrams, and text. Little is known about the design space of this kind of visual note taking. With an eye towards informing the implementation of digital equivalents of sketchnoting, inking, and note taking, we introduce a classification of sketchnote styles and techniques, with a qualitative analysis of 103 sketchnotes, and situated in context with six semi-structured follow up interviews. Our findings distill core sketchnote components (content, layout, structuring elements, and visual styling) and dimensions of the sketchnote design space, classifying levels of conciseness, illustration, structure, personification, cohesion, and craftsmanship. We unpack strategies to address particular note taking challenges, for example dealing with constraints of live drawings, and discuss relevance for future digital inking tools, such as recomposition, styling, and design suggestions